WO 2004/054269 



PCT/EB2003/005536 



CLAIMS: 

1 . A system for post-processing of decoded digital video, comprising: 

a metric calculation unit for calculation of a metric M for determining the type, 
5 aggressiveness, and order of application of a plurality of post-processing modules to the 
decoded digital video, the metric being based on block-based coding information obtained 
from the decoded digital video; 

a post processing unit for improving the quality of the decoded digital video based 
on the metric M, comprising the plurality of post-processing modules; and 
10 a control unit for controlling the activation of at least one post-processing module, 

of the plurality of post-processing modules of the post-processing unit, based on the metric 
M, 

wherein, the quality of the decoded digital video is improved by the control unit activating, 
in order, at least one of the plurality of post-processing modules and the at least one 
1 5 activated post-processing module processing the digital video based on the metric M. 

2. The system of claim 1, wherein said plurality of post-processing modules comprises 
at least one algorithm of each type selected from the group of types consisting of artifact 
reduction, sharpness enhancement, and resolution enhancement. 

20 

3. The system of claim 2, wherein the at least one artifact reduction algorithm 
comprises at least one of a luminance deringing algorithm based on the metric M and a 
chrominance deringing algorithm based on the metric M. 
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4. The system of claim 2, wherein the control unit further comprises a first mechanism 
that activates the at least one artifact reduction algorithm and turns off the at least one 
sharpness enhancement algorithm according to the formula: 

M < VPJTHRED 

5 and turns off the at least one artifact reduction algorithm and activates the at least one 
sharpness enhancement algorithm, otherwise, 

wherein VPJTHRED is a pre-determined threshold and once activated, the algorithm 
determines how "aggressively" the algorithm is performed based on the value of the M 
metric. 

10 

5. The system of claim 2, wherein the control unit further comprises a second 
mechanism that determines if the algorithm that was activated performed well and if so 
activates the algorithm that was turned off. 

15 6. The system of claim 4, wherein the at least one artifact reduction algorithm 
comprises at least one of a luminance deringing algorithm based on the metric M and a 
chrominance deringing algorithm based on the metric M. 

7. The system of claim 4, wherein the metric M calculated is a unified metric for 
20 digital video processing (UMDVP), wherein the values of the UMDVP metric are in the 

range of [-1,1]. 

8. The system of claim 7, wherein the at least one artifact reduction algorithm 
comprises at least one deringing algorithm based on the metric UMDVP. 

25 
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9. The system of claim 8, wherein isolated zero values of UMDVP in the 
neighborhood of a pixel at location (ij) having a UMDVP value of 1, are replaced by 1 to 
prevent performing the deringing algorithm on an isolated pixel as well as excessive 
blurring for the neighborhood in which the UMDVP values are a mix of Is and 0s, 

5 wherein a neighborhood is nxn pixels surrounding the pixel being deringed. 

10. The system of claim 9, wherein: 

the deringing algorithm is a luminance deringing algorithm having at least one 
filter, the at least one filter being adapted to - 
10 a. select a luminance filter for the pixel at location (ij) using a 3x3 

neighborhood size, according to whether the UMDVP values indicate that the 3x3 
neighborhood of the pixel at location (i j) is homogeneous and the pixel at location 
(i j) has a negative UMDVP value, 

b. with the selected filter, calculate a filtered value for the luminance at pixel 
1 5 (i j) based on the UMDVP value at (i j) , and 

c. calculate a maximum displacement of the filtered luminance value at 
location (ij) from the original luminance values at location (i j) based at least in 
part on the UMDVP value at (i j), and 

d. replace the original luminance values at location (i j) by the filtered one 
20 based on a function of the calculated maximum displacement of the filtered value 

from the original value. 

1 1 . The system of claim 10, wherein the filter value for the luminance at pixel(i j) is 
25 YJ51t(io) = Y(i j) -XUMDVP(i j)) * hp(i j) 
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wherein, Y(i j) is the original luminance value,y(UMDVP(ij)) is a function of UMDVP(ij) 
and hp(i j) is a high-pass signal. 



1 2. The system of claim 1 1 , wherein 

5 

AUMDVP(ij)) = (l-UMDVP(ij))/a 

where "a" is selected from the sequence 2 n = 2, 4, 8, ... for n a positive integer. 13. 
The system of claim 12, wherein for "a" = 4 the calculation of hp(ij) is 
1 0 accomplished using the following filter kernel: 
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15 and the output of the filter kernel is multiplied by 0.5 to prevent very strong low-pass 
filtering. 

14. The system of claim 10, wherein the function of the calculated maximum 
displacement is 

20 a. Max_displ = PARI + PAR2 if pixel (i j) belongs to homogenous area, 

b. Max_displ = abs(UMDVP) * PARI +PAR2, if not homogenous and 
UMDVP(ij)<=0, 

c. Max_displ = PAR2, otherwise, wherein PARI and PAR2 are pre- 
determined parameters, 
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d. if the absolute difference of the original luminance value and the filtered 
value is greater than the calculated Max_displ, then either the original value will be kept or 
shifted only by the Max_displ 
Y_filt(ij)=Y 
5 or YJilt = Y+Max_displ 

or YJilt - Y-Max_displ. 

15. The system of claim 15, wherein PARI =30 and PAR2 = 10. 

10 16. The system of claim 9, wherein: 

the deringing algorithm is a chrominance deringing algorithm having a filter, 
the filter being adapted to - 

a. filter chrominance values at pixel (i j) using a 3x5 neighborhood size, when 
the UMDVP values indicate that a 7x7 neighborhood of the pixel (ij) is 

15 homogeneous, 

b. calculate filtered values for the chrominance at pixel (i j) based on low-pass 
filtering, 

c. calculate a maximum displacement of the filtered chrominance values at 
location (i j) from the original chrominance values at location (i j) based at least in 

20 part on the UMDVP value at (i j), and 

d. replace the original chrominance values at location (i j) by the filtered ones 
based on a function of the calculated maximum displacement of the filtered values 
from the original values. 
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17. The system of claim 1, wherein said control unit serially activates said post- 
processing modules of the plurality of post-processing modules of the post-processing unit, 
based on said metric. 

5 18 The system of claim 17, wherein said post-processing modules comprise at least at 
least one artifact reduction algorithm and at least one of a sharpness and resolution 
enhancement algorithm. 

19. A method for post-processing of decoded digital video to improve the quality of the 
10 decoded digital video, comprising the steps of: 

providing a mechanism that calculates a metric M for determining the type, 
aggressiveness, and order of application of a plurality of post-processing modules to the 
decoded digital video, the metric being based on block-based coding information; 

providing a mechanism comprising a plurality of post-processing modules that post- 
15 process the decoded digital signal to improve the quality of the decoded digital video based 
on said metric; 

providing a control unit for the activation of at least one post-processing module, of 
the plurality of post-processing modules of the post-processing unit, based on said metric, 

calculating a metric M for controlling post-processing of each pixel of the block 
20 based on the metric; and 

activating at least one of the plurality of provided post-processing modules whose 
selection and processing is based on the calculated metric M to improve the quality of the 
decoded digital. 
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20. The method of claim 19, wherein said step of providing a plurality of post- 
processing units comprises the step of providing at least one artifact reduction algorithm 
and at least one of a sharpness and resolution enhancement algorithm. 

5 21. The method of claim 20, wherein the step of providing at least one artifact reduction 
algorithm further comprises the step of providing at least one luminance deringing 
algorithm based on the metric M and at least one chrominance deringing algorithm based 
on the metric M. 

1 0 22. The method of claim 20, wherein the activating step further comprises the steps of: 
providing a pre-determined threshold, VPJTHRED; 
if M < VPJTHRED, performing the substeps of - 

a. turning off the at least one sharpness enhancement algorithm, and 

b. activating the at least one artifact reduction algorithm, 
15 if M>= VPJTHRED, performing the substeps of - 

c. turning off the at least one artifact reduction algorithm, and 

d. activating the at least one sharpness enhancement algorithm, 
determining by the activated algorithm, how aggressively the algorithm is 

performed based on the value of the metric M. 

20 

23. The method of claim 22, wherein the step of providing at least one artifact reduction 
algorithm further comprises the step of providing at least one luminance deringing 
algorithm based on the metric M and at least one chrominance deringing algorithm based 
on the metric M. 

25 
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24. The method of claim 23, wherein the step of calculating the metric M is further 
based on a mechanism that calculates M as a unified metric for digital video processing 
(UMDVP), 

wherein, the values of the UMDVP metric are in the range of [-1,1]. 

25. A program product stored on a recordable medium for performing post-processing 
of a decoded digital video, comprising: 

means for post-processing the decoded digital video based on a calculated metric; 

means for calculating a metric, based on block-based coding information obtained 
from the decoded digital video, for determining the type, aggressiveness, and order of 
application of the post-processing means to the decoded digital video; 

means for controlling the activation and order of activation of the post-processing 
means using the calculated metric. 
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